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(application filed on or after May 29, 2000) 
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~ The MAILING DATE of this communication appears on the cover sheet with the correspondence address- 

All claims being allowable, PROSECUTION ON THE MERITS IS (OR REMAINS) CLOSED in this application. If not included 
herewith (or previously mailed), a Notice of Allowance (PTOL-85) or other appropriate communication will be mailed in due course. THIS 
NOTICE OF ALLOWABILITY IS NOT A GRANT OF PATENT RIGHTS. This application is subject to withdrawal from issue at the initiative 
of the Office or upon petition by the applicant. See 37 CFR 1.313 and MPEP 1308. 

1 . |EI This communication is responsive to response to non-final action filed on 07/21/2010. 

2. The allowed claim(s) is/are 7,18,19,32,37 and 38 . 

3. □ Acknowledgment is made of a claim for foreign priority under 35 U.S.C. § 119(a)-(d) or (f). 

a) □ All b)DSome* c) □ None of the: 

1. □ Certified copies of the priority documents have been received. 

2. □ Certified copies of the priority documents have been received in Application No. . 

3. □ Copies of the certified copies of the priority documents have been received in this national stage application from the 

International Bureau (PCT Rule 17.2(a)). 
* Certified copies not received: . 

Applicant has THREE MONTHS FROM THE "MAILING DATE" of this communication to file a reply complying with the requirements 
noted below. Failure to timely comply will result in ABANDONMENT of this application. 
THIS THREE-MONTH PERIOD IS NOT EXTENDABLE. 

4. □ A SUBSTITUTE OATH OR DECLARATION must be submitted. Note the attached EXAMINER'S AMENDMENT or NOTICE OF 

INFORMAL PATENT APPLICATION (PTO-152) which gives reason(s) why the oath or declaration is deficient. 

5. □ CORRECTED DRAWINGS ( as "replacement sheets") must be submitted. 

(a) □ including changes required by the Notice of Draftsperson's Patent Drawing Review ( PTO-948) attached 

1 ) □ hereto or 2) □ to Paper No./Mail Date . 

(b) □ including changes required by the attached Examiner's Amendment / Comment or in the Office action of 

Paper No./Mail Date . 

Identifying indicia such as the application number (see 37 CFR 1. 84(c)) should be written on the drawings in the front (not the back) of 
each sheet. Replacement sheet(s) should be labeled as such in the header according to 37 CFR 1.121(d). 

6. □ DEPOSIT OF and/or INFORMATION about the deposit of BIOLOGICAL MATERIAL must be submitted. Note the 

attached Examiner's comment regarding REQUIREMENT FOR THE DEPOSIT OF BIOLOGICAL MATERIAL. 



Attachment(s) 

1 . ^ Notice of References Cited (PTO-892) 

2. □ Notice of Draftperson's Patent Drawing Review (PTO-948) 

3. S Information Disclosure Statements (PTO/SB/08), 

Paper No./Mail Date 

4. □ Examiner's Comment Regarding Requirement for Deposit 

of Biological Material 



5. □ Notice of Informal Patent Application 

6. □ Interview Summary (PTO-413), 

Paper No./Mail Date . 

7. □ Examiner's Amendment/Comment 

8. ^ Examiner's Statement of Reasons for Allowance 

9. □ Other . 




Notice of Allowability 



Part of Paper No./Mail Date 20100723 
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DETAILED ACTION 

1 . This communication is in response to the Amendments and Arguments filed on 
07/21/2010. Claims 7, 18, 19, 32, 37, and 38 remain pending and have been examined. 
The Applicants' amendment and remarks have been carefully considered and have 
overcome the previous rejections. Hence, the case is in condition for allowance. 

2. All previous objections and rejections directed to the Applicant's disclosure and 
claims not discussed in this Office Action have been withdrawn by the Examiner. 

Reasons for Allowance 

3. Claims 7,18,1 9, 32, 37, and 38 allowed. 

4. The following is an examiner's statement of reasons for allowance: 

The closest prior art of record teaches Stevens et al. teaches a method of 
learning with an automatic speech recognition system, the method comprising; 
detecting a change to dictated text (see col. 26, lines 17-24, and lines 31-39, where the 
system recognizes an edit or revision); utilizing a computer processor that is a 
component of a computing device to automatically infer whether the change is a 
correction, or editing (see col. 26, lines 17-24, and lines 31-39, where the system 
recognizes an edit or revision); and if the change is inferred to be a correction, 
selectively learning from the nature of the correction without additional user interaction 
(see col. 26, lines 31-39, acoustic models are adapted based on user changes and 
recognition results), wherein selectively learning from the nature of correction includes: 
a user's pronunciation deviated from an existing pronunciation known by the system by 
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doing a comparison (see col. 27, lines 1-21, where a comparison of an original acoustic 
model and a edited acoustic model is compared); determining if the corrected word 
exists in the user lexicon (see col. 26, lines 52-60, where the best representation of the 
word is determined for adaptation), selectively changing a parameter associated with 
the pronunciation (see col. 27, lines 1-21, when the difference is within a threshold then 
the acoustic model is adapted). However, Stevens does not specifically teach to 
selectively changing at least one parameter, forced alignment, the two separate 
determinations, and the confidence score being calculated using the function 
"1/[d/f/log(len 1 +Ien2)], where d is the distance between the recognized pronunciation 
and a best match in a lexicon, f is a frequency that the same pronunciation is 
pronounced, and lenl and Ien2 are the lengths of phonemes in a new pronunciation and 
the closest pronunciation. 

Honda does teach to selectively change at least one parameter (see col. 7, lines 
6-12, where acoustic model adaptation alter parameters such as the average vale and 
variance that defines the transition probability of the HMM). However, Honda does not 
specifically teach the two separate determinations, forced alignment, and the 
confidence score being calculated using the function "1/[d/f/log(len 1 +Ien2)], where d is 
the distance between the recognized pronunciation and a best match in a lexicon, f is a 
frequency that the same pronunciation is pronounced, and lenl and Ien2 are the lengths 
of phonemes in a new pronunciation and the closest pronunciation. 

Beaufays et al. does teach the forced alignment of a wave (see page 2594, sect. 
2, step 1 , where a forced alignment of two waveforms is performed) based on at least 
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one context word (see page 2574, sect. 2, step 2, where the context is use to determine 
a region of worst acoustic match and in step 3, alternative pronunciations are 
suggested), such as the average vale and variance that defines the transition probability 
of the HMM). However, Beaufays does not specifically teach the two separate 
determinations, and the confidence score being calculated using the function 
"1/[d/f/log(len 1 +Ien2)], where d is the distance between the recognized pronunciation 
and a best match in a lexicon, f is a frequency that the same pronunciation is 
pronounced, and lenl and Ien2 are the lengths of phonemes in a new pronunciation and 
the closest pronunciation. 

Nassiff et al. teaches a method of learning with an automatic speech recognition 
system, the method comprising: detecting a change to dictated text (see col. 5, lines 
33-40, based on deletion or typing over the words); inferring whether the change is a 
correction, or editing (see col. 5, lines 33-48, correction or editing is determined based 
on deletion (editing) or typing over the words (correction.); and wherein inferring 
whether the change is a correction includes comparing a speech recognition engine 
score (see col. 6, lines 28-31 ) of the dictated text and of the changed text (see col. 7, 
lines 50-62); if the change is inferred to be a correction, selectively learning from the 
nature of the correction without additional user interaction (see col. 6, lines 45-50), 
wherein selectively learning from the nature of correction includes determining if the 
corrected word exists in the user lexicon, selectively learning the pronunciation (see col. 
6, lines 45-50, the language model is updated when the replacement word is found on 
the alternative word list.). Furthermore, Nassiff does teach the determination if a user's 
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pronunciation deviated from existing pronunciations known by the system by a 
predetermined statistical quantity and if it is found in the system (see Figure 4). 
However, Nassiff does not specifically teach the predetermined statistical quantity being 
calculated using the function "1/[d/f/log(len 1 +Ien2)], where d is the distance between 
the recognized pronunciation and a best match in a lexicon, f is a frequency that the 
same pronunciation is pronounced, and lenl and Ien2 are the lengths of phonemes in a 
new pronunciation and the closest pronunciation. 

The present invention's use of the confidence metric enables pronunciation to be 
selectively added while preventing errors from misalignment, incorrect inferences, and 
without decreasing system effectiveness (see Applicant's Specification, page 23, last 
paragraph). 

None of the cited reference either alone or in combination thereof teach or 
suggest the "detecting", "inferring", "learning", "building", and "generating" along with 
the confidence score being calculated using the function "1/[d/f/log(len 1 +Ien2)], where 
d is the distance between the recognized pronunciation and a best match in a lexicon, f 
is a frequency that the same pronunciation is pronounced, and lenl and Ien2 are the 
lengths of phonemes in a new pronunciation and the closest pronunciation, 
respectively." as recited in claims 7 and 37. 

Any comments considered necessary by applicant must be submitted no later 
than the payment of the issue fee and, to avoid processing delays, should preferably 
accompany the issue fee. Such submissions should be clearly labeled "Comments on 
Statement of Reasons for Allowance." 
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Conclusion 

5. The prior art made of record and not relied upon is considered pertinent to 
applicant's disclosure. 

Backfried et al. (US 6,801 ,893) is cited to disclose adding new words to a 
vocabulary based on pronunciation. 

6. Any inquiry concerning this communication or earlier communications from the 
examiner should be directed to PARAS SHAH whose telephone number is (571)270- 
1650. The examiner can normally be reached on MON.-THURS. 7:30a. m.-4:00p.m. 
EST. 

If attempts to reach the examiner by telephone are unsuccessful, the examiner's 
supervisor, James Wozniak can be reached on (571)272-7632. The fax phone number 
for the organization where this application or proceeding is assigned is 571-273-8300. 

Information regarding the status of an application may be obtained from the 
Patent Application Information Retrieval (PAIR) system. Status information for 
published applications may be obtained from either Private PAIR or Public PAIR. 
Status information for unpublished applications is available through Private PAIR only. 
For more information about the PAIR system, see http://pair-direct.uspto.gov. Should 
you have questions on access to the Private PAIR system, contact the Electronic 
Business Center (EBC) at 866-217-9197 (toll-free). If you would like assistance from a 
USPTO Customer Service Representative or access to the automated information 
system, call 800-786-9199 (IN USA OR CANADA) or 571-272-1000. 
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